“Calhoun 


Institutional Archive of the Naval Postgraduate School 





Calhoun: The NPS Institutional Archive 
DSpace Repository 


Theses and Dissertations 1. Thesis and Dissertation Collection, all items 


1968-06 


On integer linear programming. 


Hobart, Charles Wendell 


Monterey, California. Naval Postgraduate School 
http://hdl.handle.net/10945/40068 


This publication is a work of the U.S. Government as defined in Title 17, United 
States Code, Section 101. Copyright protection is not available for this work in the 
United States. 


Downloaded from NPS Archive: Calhoun 


Calhoun is the Naval Postgraduate School's public access digital repository for 


\§ D U DL EY research materials and institutional publications created by the NPS community. 
«iis Calhoun is named for Professor of Mathematics Guy K. Calhoun, NPS's first 


NNN KNOX appointed -- and published -- scholarly author. 


LIBRARY Dudley Knox Library / Naval Postgraduate School 
411 Dyer Road / 1 University Circle 


http://www.nps.edu/library Monterey, California USA 93943 





' UNITED STATES 
NAVAL POSTGRADUATE SCHOOL 


ance 





eet ee . 


THESIS 





ON INTEGER LINEAR PROGRAMMING 


by 


Charles Wendell Hobart 


June 1968 


THESIS 
H59 








ON INTEGER LINEAR PROGRAMMING 


by 
Charles Wendell Hobart 


Captain, United Stfftes Army 
B.S. Ed., Northeastern iversity, 1961 


Submitted in partial fulfillment of the requirements 
for the degree of 


MASTER OF SCIENCE IN OPERATIONS RESEARCH 


from the 


NAVAL POSTGRADUATE SCHOOL 
June 1968 









Signature of Author Ly 


Approved by —— 
s visor 





Analysis 





Academic Dean 


AD sy 0-2 





ABSTRACT 
A survey of the methods of solving the integer program, - 
n n 
max c.x. subject to a,.X,. = b, (i=l,...,m) and 
te i es ia See , 


2, > 0 and integer (j=l,...,n) is presented. Emphasis is 
placed on methods developed since 1960 with many as yet un- 
published methods presented. Examples are given for the 


unpublished methods. ee | 
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1. Introduction: and Brief History 


This is a survey of the progress that has been made in 
the solving of linear programming problems when variables 
must take on integer values. The field is divided into pure 
integer programming, when all the variables must be integers, 
and mixed integer programming, when only specified variables 
must be integers. The subject is also known as discrete 
programming or integer linear programming abbreviated to 
integer programming which appears to be the preferred term. 

The integer programming problem is to 


= 


n 
(1) Maximize }) c 


Subject to sha a5 4% = b, (i=1,...,m) 


x5 > 0 and integer (j=l,...,n), 


where for simplicity and without loss in generality we as- 
sume all ayy: Cyr bs are integer valued constants. 

There are five approaches capable of solving problems 
of this type: cutting plane methods, primal methods, branch 
and bound methods, partial enumeration methods, and dynamic 
programming procedures. These various methods will be dis- 
cussed in the succeeding sections. 

Although an attempt is made in this thesis to delineate 
the various methods of solving integer linear programs, there 
are no clear cut divisions. Many authors have grouped branch 
and bound, branch and exclude, and dynamic programming tech- 


niques into a broad category of partial enumeration methods. 








If a solution of (1) as a linear program does not have 


‘the required integer properties then methods for achieving 
it must be invoked. A basic approach common to most methods ¢ 
is to successively deduce supplementary linear constraints 
from the linear constraints of (1) and the integer require- 
ments until a new linear program is obtained whose solution 
satisfies the integer requirements. 
The idea of new constraint generation appears to have 
been first advanced by Dantzig, Fulkerson, and Johnson [7] 
in 1954 in their work on the traveling salesman problem. 
In 1958 Gomory [11] developed a systematic method for new 
constraint generation in his "Method of Integer Forms" for 
solving pure integer programming problems in which all var- 
iables are required to be integer valued. This method guar- 
antees that an integer solution is found (if any exist) in . 
a finite number of steps. In 1960 Gomory devised another 
method, the "All Integer Method", which requires only addi- 
tion and subtraction in computation provided the ass and G5 
in (1) are integer valued. The above algorithms are "dual 
methods" and as such, no feasible solution to the problem 
of interest is obtained until an optimal solution is found. 
There is, however, a method which provides primal integer 
solutions. This method is attributed to Gomory but liter- 
ature on this is scarce. Young [21] has also presented a 
similar algorithm for primal integer solutions. 
The field of mixed integer programming is less far ad- . 


vanced. Gomory [12] has extended his method of integer 





forms to deal with continuous as well as integer variables. 


A dual decomposition approach due to Benders [4] has been 
used to remedy the situation of a mixed program. In this 
approach the problem is partitioned and every stage of the 
computation involves the solution of two subproblems, a pure 
integer problem and a linear programming problem. 

Other approaches to solving pure and mixed problems 
have been proposed. In 1960 Land and Doig [20] developed 
a branch and bound technique. In 1968 Greenberg and 
Hegerich [19] developed a branch and exclude algorithm for 
the special "knapsack problem" which was extended by 
Greenberg [15] to the more general problem. 

Partial enumeration techniques have also been devised 
by Balas [1] and [2] in his "Additive Algorithm" and "Dis- 
crete Programming by Filter Method", Goeffrion [8] in his 
"Reformulation of Balas' Algorithm for Integer Programming", 
and by Glover [10] in "A Multiphase Dual Algorithm for the 
Zero-One Integer Programming Problem". An enumerative 
scheme for computation of knapsack functions by Greenberg 
[18] is presented in this paper. 

Dynamic programming procedures have also been devised 
to solve linear programming problems. Two methods by 
Greenberg [16] and [17] are presented; one for the knapsack 
problem and the second a more generalized problem of integer 


programming. 





2. Cutting Plane Methods 


Before discussing the particular algorithms of Gomory 
it is appropriate to define some terms which will be used 
throughout the discussion of the algorithms. A "feasible 
solution" is a solution where all variables that are required 
to be integer are integer and all variables that have to be 
non-negative are non-negative. Since Gomory's methods are 
expressed more neatly in terms of an objective function to 


be maximized the objective function will be 
n 
(2) Maximize Xo = as . oF 


An "optimal feasible solution" is a feasible solution 
which yields the largest value of Xo-° 
In the original method for pure integer programming, 
the "Method of Integer Forms", one starts by solving the 2 
problem by ignoring the requirement that the variables must 
be integer. If this produces a solution in integers, then 
the problem is solved. Otherwise one considers the expres- 
sion for some basic fractional variable in terms of the 


non-basic variables. Let this be 


h 


where b, denotes the 3° non-basic variable. 


Now write the coefficients as; in the form 


where the Das are all integers (positive or negative) and 


the £33 are fractions such that: 0 < f 54 <<) a 





Next consider the expression: 


This expression must be an integer since it differs 
from ~X, by an integer. Also, it cannot be less than -f50 
n 
since the expression ) £4t. is non-negative. So s isa 
j=1 Da 
non-negative integer and can be introduced as a new variable 
of our problem. Its value at the current trial solution is 


—E So the constraint that s > 0 "cuts off" this solution 


s0° 
and enables us to continue optimizing using the dual simplex 
method. 

Gomory's second method for pure integer programming, 
the "All Integer Method", proceeds differently. One does 
not start by solving the problem in continuous variables 
since this method involves keeping the coefficients integral. 
One starts by making the problem dual feasible, perhaps by 
adding an artificial constraint that the sum of the non-basic 
variables is less than or equal to some arbitrarily large 
number. After this every pivotal row is a new cut generated 
in such a way as to make the pivot equal to -l. This en- 
sures that the integral tableau remains integral. The proce- 
dure for generating pivotal rows is as follows: Suppose X., 
is some variable that is negative in the current trial solu- 


tion, then express X in terms of the non-basic variables as 


where aso is negative. 








Let A be any positive quantity and write 


as, = m4 + f, 


J 

where ns; is an integer and > 
0 < fs s < Xr e 

Consider the expression: 


s=n - Me .G. : 
sO ha 


This expression must be integral and positive since 





For any value of A , N50 sl ES aso < 0. So the new con- 





straint that s > 0 "cuts off" the current trial solution. 

The pivot can be made equal to -1l by taking A large enough 
since for arbitrarily large i all Ns will be 0 or -1 depend- 
ing on whether ag, is non-negative or not. 

Just as constraints for the Method of Integer Forms can 
be generated from linear combinations of rows provided it is 
integral, constraints for the All-Integer Method can be gen- 
erated from linear combinations of rows provided it is non- 
negative. 

The third and final cutting plane method which we will 
consider is Gomory's method for the mixed integer problem. 
This method is similar in part to the method of Integer 
Forms in that one first solves the problem ignoring the re- 
quirement that any variables must be integral. If some var- 


iable that must be integer, say Xr equals n tf a where . 


s0 


n is a non-negative integer and 0 < Eo <1, then xX, can 


s0 
be expressed in terms of the current non-basic variables as 


10 





where the non-basic variables ty are divided into two clas- 


ses such that all a_. > 0 and all b.. > 0. 
sj - sj - 


Consider the expression: 


. 
0 
s=-f£, + Jat. + wooo jb iat. . 
s0 ; a1°3 l-f.9 2° 835 


This expression is negative at the current trial solution 


but is must be non-negative for any integral value of X° 


This is because if x, — Neo < 0, then 
i }a,5t 4 Ib, 4% = -(x,-N59) > 0 
and 2t& x_ - > 1, then 
s sO — 
1-f.9 
ca 8 ~ fagsty * Ib, ¢ a dg < 


So s > 0 and this is a valid cut. If any of the non-basic 
variables must be integral then an expression for Xs plus an 
integer combination of the non-basic integer valued var- 
iables, such that a4 < E50 or Ref < (1-£.,) for all such 


variables can be used. 





1 





<P Primal Methods 


The primal approach involves progressing from one fea- 
sible solution to another with a larger value of the objec- - 
tive function or else proving that no better solution can 
exist. A method, attributed to Gomory, and conveyed to the 
author in private conversation with Greenberg is a method 


of solution to the general problem 


n 
(3) Maximize } c.x, 
4=1 x7 J 
n 
Subject to i aX. = by (i=1,...,m) ; 
j=l 
x, > 0 and integer. 
Along with the discussion of the algorithm will be an illus- é 


trative example which is 
(4) Maximize X, + Xo 
Subject to 3 x, + 2 Xo < q 
X11 X> > 0 and integer. 
Adding a slack variable, S, to our constraint equation and 
making a substitution x, = xy and x, = Xo (4) may be re- 


written as 


(5) Maximize x) + Xo 


Subject to 3 x) + 2 Xo +S=7 
- %, + x, = 0 
- Xo + Xo = 0 . 


Xp, Xo 2 0 and integer. 


12 





Set up the first tableau using (5). This is the following 


with the last row of the tableau the coefficients of the 
objective function. Since this is a maximize problem, the 
pivot column will be the column where the coefficient of 
the objective function is the greatest. In this case our 
pivot column will be either x1 or Xo Arbitrarily select 
the x1 column. The criteria used for selection of the pivot 
row is 
Di 
min t=) where o is the pivot column. 
a. > i 
io 
In our problem the pivot element is 3. 
We divide the pivot row by the pivot element giving 
2 1 7 


3 gf © Rs 


(6) 1 ; 


Rewriting (6) gives us 


or 


_ -_ 
(7) 3%, + 38 - 3 = 2 aes 


Using (6), we take the greatest integer < the elements 
of the pivot row giving us 
a 0 0 0 0 2//. 
We must always keep the slack variable, S in our case, 
and the original variables, xy and Xo) in the basis. 
Since the right side of (7) implies x) < 2, we must 
add a slack variable, say ti, giving us 


(8) x 


lL lL 


$3 2 « 

We now eliminate our pivot variable x) from the equa- 
tions in our tableau by using (8). 

Next we determine if this is an optimal solution. If 
not we must repeat this procedure. If our pivot element is 
l at any step, we must modify the procedure by substituting 
dummy variables for the variable we want to keep in the 
basis. 


Continuing with our example and using (8) our next 


tableau is 


ct 
mi 
n 
*~ 


0 ol 0 0 1 0 
-1 il 0 0 0 2 : 
Note that the x1 column has been eliminated. 
Our next iteration allows us to eliminate Xo from the 


basis by rewriting line one of the tableau as 


3 = 1, 1 vn +x,=0 . 
“set ee ae tO At ale 


14 








Substituting xX, = 2t, - t, in our tableau gives 


4 ty to s x) Xo b 
i =2 1 0 0 1 
° l 0 0 1 0 2 
-2 1 0 0 i 0 

i o.—| @ 0 © 2 « 


Using the column headed by t, as our pivot column now 
requires the use of our modified procedure since our pivot 
element is l. 

Writing line one of the above tableau, not including 


S, gives 





t, = 2t. SL & 


1 
Adding a slack variable ts gives 
* ty - 2to + t3 = lL 


or t, =l1l+ 2t, t, - 


Substituting this in our previous tableau and elimina- 


ting the ty column gives 


ts ts Ss x Xo b 
-l 0 l 0 0 
-1 2 0 di: 0 l 
2 =3 0 0 lL 2 
-1 Z 0 0 0 3 
“| Using the column headed by t, as our pivot column 


allows us to eliminate to. 


LS 





Writing line two of the above tableau after dividing 


by the pivot element gives 


1 . 
~ Ff3 + to + 5x, 


and using our procedure gives 


—tm + t 


3 2 


Adding a slack variable, t, to 


to substitute 


t3 ty s 
~l 0 i 
l ~2 0 
=1 3 0 
0 =] 0 


which is an optimal solution with x, = 1, X5 =m 2, a= 0, 
and 3 as the value’ of the objective function. 
In this problem there is an alternate solution indica- 


ted by the 0 element in the last row of the t3 column in 


the previous tableau. 


Continuing with our procedure and using the ts column 
as the pivot column, we obtain an alternate optimal solution 


of x, = 0, Xo = 3, s = 1, and 3 as the value of the objec- 


tive function. 
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= 0 


eo. FF oso -F 


0 


Nie 


this equation allows us 


I 
0 


2 
3 





4. Branch and Bound Methods 


A third approach to the integer programming problem is 
the branch and bound technique. This involves setting up 
a tree of linear programming problems. The root of the tree 
is the problem in which all integrality constraints are 
ignored. If the solution satisfies the integer requirements 
then the problem is solved. Otherwise a branching procedure 
is employed to obtain an integer solution to the problem. 

Three methods will be discussed in this section. The 
first is the Land and Doig procedure [20] which was pub- 
lished in 1960, the second method by Greenberg and Hegerich 
[19] which was devised in 1968 and applied to the knapsack 
problem, and the third method by Greenberg [15] in 1968 
which was an extension of [19] to the more generalized 
problem. 

The general approach of the Land and Doig procedure is 
to solve the integer program ignoring the integrality con- 
straints. If the solution x? WG yh ieee) satisfies 
the integrality constraints the problem is solved. If not 
then the present value Yo of the objective function provides 
an upper bound on the value of the optimal solution to the 
integer program. 

A variable X, which is required to be integer valued 
but currently is not, is considered. The variable must be 
forced to take on an integer value hence decreased to [x2] 
or increased to at least [x0] + 1 where [xy] is the great- 
est integer less than or equal to Xy The entire range of 


possible integer values for x, May be found by solving the 


17 


two linear programs max x, and min x, subject to the con- 
straints of (2). For each possible integer value in the 
range the max Yo subject to the constraints of (2) with x, 
fixed can also be computed by linear programming. Thus, a 
all possibilities in the form of a directed tree can be 
enumerated with the root of the tree, with rooted node 0, 
corresponding to x? and directed branches (0,i) with node 
i corresponding to the solution xt of the linear program 
max Yq subject to the constraints of (2) and x, set at some 


specific integer value, say x - From each new node the 


(i) 
k 


same procedure can be applied. Continuing until no further 
branching is possible, every terminal node will either cor- 
respond to a feasible integer solution or to some sequence 
of integer valued choices which do not satisfy (2). The 
feasible node with max Yo provides the optimal solution. 
The Land and Doig procedure involves this enumeration 


but attempts to search only a subset of the possibly immense 





tree described. The idea is to develop only that part of 
the tree which contains the optimal solution. Any node in 
the directed tree must have a value of Yo no greater than 
its predecessors' since branching is imposing an additional 
variable to some integer value, i.e., imposing an additional 
constraint. Also if at any node X* of the tree, > is 

(i) 

P 


integer restricted and x is not integer then the integer 


values for x, which will result in the least decrease in Yo 
after branching must be either ae or ta + 1. Thus 4 
we have reduced the total number of branches that need be 


explored. 
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Another approach to the branch and bound or more pre- 
cisely branch and exclude method is that of Greenberg and 
Hegerich. Their original work was with the knapsack problem 
and later extended by Greenberg to the generalized integer 
programming problem. 

They present a branch and bound algorithm and a branch 


and exclude procedure which is used to solve the problem 


n 
(9) Maximize y  vaXs 


an = % 
n 
Subject to } wx, <W 
i=l 
x. = OL (eu oe, ° 


i 

It is assumed that Vy and W,; are positive integers and 
vy /Wy > V>/W> > wee D> V,/¥n° 

The problem is first solved as shown by Dantzig [6] 


where the 0 < xX, < 1. This solution is given by 


x Ge 2k Ue a, <i oe 
i 
x, = 0 af 1 > ¥ 
pi 
W- W 
i } rt 
es Ww 
rE 


where r is the least integer (0 < r <n) for which 


w. > W. If no xr exists then all x, = 1. If x_= 0, 
, i- i r 
7 << 2 
then we have the optimal solution to (9). 

If x, is fractional the value of the objective function 
is 2(1) = J v, + v,x,. 2(n) is the value of the objective 
a 


L§ 





function at node n. The branch and bound method is 


al. 


2(a). 


(b). 


3{a). 


(b). 


Label node 1 with Z(1). 

Find the terminal node with the largest 
value of Z(n). This is the node at which 
the next branching will take place. Any 
node (except one) contains the effect of 
assigning values to variables and solving 
(9) with the assigned values of the 
variables added as constraints. 

If the solution at node n has all variables 
assigned an integer value, this is the 
optimal solution to (9). If not, proceed 
to step 3. 

Set n = n + 1 and some unassigned variable, 


say x, to 0. Solve (9) with all assigned 


t 
variables added as constraints. Label 

node n with the value Z(n) and proceed to 
3b) . 

Set n=n+landx,=1. Solve (9) with 
all assigned variables added as constraints. 
Label node n with the value Z(n) and go to 


step 2. 


The criteria used to select x, in step 3(a) is to take 


the variable that is fractional at node n. 


As is common with most branch and bound techniques they 


require large amounts of computer storage. The branch and \ 


exclude algorithm which is described next is designed to 


eliminate the problem of storage. The algorithm first finds 
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an obvious integer solution to the constraints of (9). This 


solution is taken as a lower bound to the optimal solution. 
A branch of a tree is developed and each part explored until 
the lower bound is reached or until a new feasible solution 
is found that represents a larger lower bound. Then back- 
track and develop new branches of the tree developing pos- 
sibly larger lower bounds. Further branching is excluded 
when the lower bound is reached. The algorithm stops when 
all new branches are excluded. The only information that is 
stored is the current lower bound solution and the branch 
routing. At the end, the lower bound solution is optimal. 

Before the algorithm is presented certain terms must 
be defined. 


Define S(X9 1X 7-+ + 7X) as the current lower bound solu- 


n 
tion where the x, are all given and x, = A V,%;° 


Define X(X, -Xor00+ 1X) to indicate assigned variables. 
A value x, = 2 (or any number not equal to zero or one) 
indicates the variable is unassigned. An assigned variable 
will have the value zero or one. 


th 


Define R(L) as the index of the L assigned variable. 


Define Z(L) as the value of the objective function at 
the Nia level of a branch. 
The solution to (9), with L assigned components of X 


added as constraints is 


x. if iL. << amy Bee Bl). Cite 


i 


x, Oifi>r>r, if R(j) (jHl,...,L) 


Zt 





(10) *R (3) = 0 orl (j=1,...,L) depending on the 


assignment 
L 
a ato (UR) ys Xu /, w.) /w ; 
Fe aca R(i)“R(i) hee i xr 
A , P 
Z(L+1) = Wey ete, +). ) Ve ie eee 
goa BHR) * cheery “AE ae 


where the set M is given by 
M(L) =(fiji <r, i # RCW} 6(j=1,./. ay) 
and r is the least integer (0 < r < N) for which 


L L 


w. ¢+wo>wWwW- , 


Ww +X : ° 
ieee: eae ial TR 


If no r exists we have all x; = 2 for iw Beat (jal,...l). 
A lower bound to the solution of (9) is given by 


L 


yeh 2 VRC) *R (4) * 1 va , 


ieM(L) * 
The algorithm is as follows: 

1. Set L = 1 and all components of X to two. 

2, Solve (9) with 0 <x, <1. If the solution is all 
integer then this is the optimal solution. If not, the‘solu- 
tion is x, = BAR, Leese eX iy = 1 and x is fractional. 


2 
Calculate x) = ) v, and form $(x,,1,1,...,1,0,0,0) as a 
<r 


lower bound to the optimal solution, where the zero compor 
nents in S represent x, = 0, i>r. Set R(l) = r and the 
th component of X to zero. 

3(a). Solve (9) with the L assigned components of X 


added as constraints. We obtain (10). If [z(1 + 1)] < Xo 


22 





go to step 4. If Z2(L+1) > X, and we have an integer solu- 


tion, take Xo = Z(L+1), form a new S (Xp +x 


and go to step 4. If [Z(L+1)] > x 


yrrte eX) from (10) 
0 and we do not have an 


integer solution, go to 3(b). 


(ay. “Le xn) > Xr take Xo x(L) and form a new 


S (Xo /Xpr0-+7%,) from (10) with x. 0. In any case, set 
L=L+1, take R(L) = r, and set the R(L) component of X 
to zero and go to 3(a). 

4(a). If the R(L) component of X is equal to zero 
change the component to one and go to 3(a). If the R(L) 
component of X is one go to 4(b). 

(b). If L= 1, the optimal solution is S(Xp Xp reser 
x): If L # 1, change the R(L) component of X to two, set 
L = L-l, and go to 4(a). 

This completes the algorithm. R(L) represents a rout- 
ing of assignments along the branch. Only one branch is 
studied at a time with preference given to assigning the 
value of zero to the fractional variable. This allows lower 
bounds to be achieved more rapidly. The only permanent 
storage information required is the current lower bound solu- 
tion S, the assigned variables R(L) at level L of the branch, 
and the assignment vector X. 

An extension of the previous algorithm is that of Green- 
berg [15] in which he presents an algorithm for the solution 
of the integer programming problem 

(ll) Minimize 2Z = CX 

Subject to AX = B 
0< x4 < x, integer, j=l,...,n, 


Pe <3 
23 





where C is an n-vector, B is an m-vector, A is an mxn matrix 


and the b, are positive integers. Any or all of the b. may 
be infinite. It is assumed that the elements of C, B and F 
A are integers. 
The two phase simplex method is used to solve (11) to- 
gether with the bounded variable technique of Dantzig. After 
solving (11) as a linear program, the condition x, < [xp] or 
x, 2 [x] + 1 for a basic variable x, with its value x, as 
fractional is imposed. The solution for the linear program 
is then infeasible. Then x, is placed at either the new up- " 
per bound [x)] ox at a lower bound [xy] + Ue an artificial 
variable equal to the amount of the infeasibility produced 
(xy - [9] in the first case or [x] +1- . in the second 
case) is added, and the new bounded variable problem is 
solved by the two phase procedure. If a solution is obtained : 
to the new problem that is fractional, an additional condi- 


tion x < [xz] or x 


. > [x2] + 1 is imposed for a basic var- 


r 
iable x, with its value ee as fractional. The new problem 
is then solved maintaining the constraint of Xp This proc- 
ess is continued until it is necessary to backtrack which is 
done by simply removing the bounds on the required variables 
and solving the linear program to return to a previous prob- 
lem. Note that bounds on the same variable may appear 
again; the initial bounds will automatically be satisfied. 
This entire procedure enumerates possibilities for the 
solution to (11) in a directed tree. The rooted node cor- Y 
responds to 2" Only one branch is investigated to the next 


node corresponding to the solution of (11) with say 
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x, 2 [xy] + 1 representing the branch. From each node the 


same procedure is repeated investigating one branch until 
we backtrack to a previous node that has had only one branch- 
ing. For example, we would branch to a node corresponding 
to the solution of (11) with x, < [xp] representing the 
branch when we backtrack to the rooted node. Any further 
backtracking to the rooted node would end the problem. This 
procedure is contained in the following algorithm: 

Define S (XQ Xp r0++ 7X,) as the current upper bound 

solution, which represents a feasible integer solu- 

tion to (11) with objective value Xp: 

Define I(L) as the index of the oe. bounded 

variable. 

Define N(L) to show the number of branchings for 


the t=) pounded variable (Initially N(L) = 0). 


Define B(L) to show the bound on the Le) bounded 
variable. 
Define G(L) = 0 to indicate the oat bounded 
variable is < B(L), and G(L) = 1 to indicate the 
pam bounded variable is > B(L). 

1. Set L = 0 and take S(XqpXyreee 2X) as a feasible 
integer solution to (11). If none is apparent 
take x, as infinite. Solve (11) as a linear program. 
If the solution is all integer the problem is solved. 
Otherwise go to 2 maintaining the canonical form of 


the solution to (11). 
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Set L=L+1. Go to 2(a). 


(a) Select a basic wieianterehat is fractional. 
Suppose the variable selected is x, with 
value x set I(L) = k, N(L) = 1 and go to 
2th) er 2(e}. 

(b) Set B(L) = [xp] and G(L) = 0. Go to 3 


i. HiGe to 3. 


(c) Set B(L) = [xy] + 1 ana G(L) 
Solve the linear program using the maintained canonical 
form with the new bounds on the variable x, where 

k = I(L). One of the cases holds: 

(a) I£ the solution produces an objective value 2 


with [Z] + 1 > x, to to 4. 


0 
(b) If the solution produces an objective value 2 
with [Z] +1 < Xo and the solution is all integer, 
redefine S(X_pXy re ++ 2X) as a new feasible integer 
solution where Xp) = Z, Xp ree Ky is the new solu- 
tion. Go to 4. 
(c) I£ the solution produces an objective value 2Z 
with [Z] + 1 < Xo and the solution is fractional 
go to 2. 
(d) If the problem has an infeasible solution go 
to 4. 
Set LL = L and go to 4(a). 
(a) If N(L) = 2, go to 4(b). Otherwise N(L) = 1; 
go to 4(c). 
(b) If L=1, the feasible solution S (Xp pXy r++ + 7%,) 
is optimal. Stop. Otherwise set N(L) = 0, 
L = L-1, and go to 4(a). 
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(c) Solve the linear programming problem starting 


from the current canonical form with the bounds 
B(L), B(L+l),..-.,B(LL) removed. If k = I(L) 
and x, does not become a basic variable then 
the solution is non-unique; x, is then made a 
basic variable. Go to 4(d). 


2, and 


(d) If G(L) = 0, set B(L) = B(L) + 1, N(L) 


go to 3. Otherwise G(L) = 1; set B(L) 


R(L) - 1, 
N(L) = 2, and go to 3. 

It should be noted in this algorithm the bounds are 
changed systematically until the optimal integer solution 
is produced. The method results in a branching process that 
requires minimum excess computer storage over that required 
to solve the linear programming problem. 

In addition, dynamic programming enumeration, similar 
to that given in [17] and developed in the dynamic program- 
ming section of this thesis, may be instituted after a frac- 
tional solution is obtained at any node to speed the calcula- 
tions. 

To illustrate the basic method, an example from [3] is 
presented where the variables are arbitrarily picked for 
branching and the branching is always taken with a greater 
than or equal sign first. The problem is to 


min 4x. + 5x 


aL 2 
when 3x1 + Xo — X3 = 2 
X) + 4x, ~ x = be 
3x, + 2X) - Xp = 7 
Xyr Xor Xgr Xyr Xe 2 0 and integer. 
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The continuous solution produces the canonical form 


& _me 
“ie tees, o's ~ 1 


= 2x + 1, = 8 
“ay {6-8 «to's * Pee 
LO 4 
7 3 Li 21242 
™7) 104° To*s * 16 
1 Tt ele 
“tere To's to - 


Since the solution is fractional we arbitrarily select the 
bound x, 2 2 added to the previous canonical form. We then 


obtain the canonical form 


ib 5 
eo ky OM ae on 
ll i! 3 

‘em aur 4" ~ = ‘ 
5 ‘lt 9 
Vea 54 = 


{ 
N 
+ 

ae 
ra 
| oe 
+ 
+ 
_ 
I 
i] 


where (Z,X1 pXo2%3sXq Xe) = (47/4, 2, 3/4, 19/4, 0, 1/2). 
We arbitrarily select Xo 2 1 and solve the previous 
canonical form with x, > 2 and x, > 1 to obtain the canonical 


form 


*” 
Ww 
' 
Ww 
a“ 
| 
i 
“ 
i) 
il 
' 
iS) 


Xs = 3x) - 2X5 = =-7 


where (Z,X) Xo1%qe%X47%Xe) = (13, 2, 1, 5, Wj) 1), which is all 


integer and becomes the solution vector S(Xq eX re+e eX.) 
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We then remove the bound Xo 2 l and apply the simplex proce- 


dure on the previous canonical form (e.g., Z may be decreased 
by decreasing Xo) and obtain the same canonical form that we 
obtained by selecting the bound x, 2 2. We them impose the 
bound x, < 0 on this canonical form in addition to Xx, 2 2 


and obtain the canonical form 


x1 + 4x, >) 7. 5 
x, + 1lx, - 3x4 = 13 
xX, + 10x, - 3X4 = 8 
-2 - 1llx, + 4x, = -20 
where the solution is (20, 5, 0, 13, 0, 8). Since Z > 13 we 


remove the bounds Xo < 0 and Xx, 2 2 and solve the previous 


canonical form to obtain our first canonical form again. 


We then take x1 < 1 and obtain the Canonical form 





3 1 ..¢ 
ae tee Ss 
in’ 3. = 1, a of 
3 ras ah. 2 
X4 + 5X1 - 2x. = 9 
7 5 _ 737 
“Et + ed 27 
where (ZX Xo o%X3e%XqrXp) we{l@, 1, 2% 3, @, @. “Sinzed > 1a 
the problem is solved with solution 2 = 13, x, = a X54 = li; 


X3 = 5; x, = Le Xe = i 


The advantages of this basic branching algorithm are 
apparent over the Land and Doig procedure even in this small 


example. This same problem solved using the Land and Doig 
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procedure as illustrated in [3] required the generation of 


five nodes. This algorithm required only four. Further, 
no additional problems are generated except that the canon- 
ical form from the original continuous solution is varied 
depending on the bounds on the variables. Each problem 


leads into the next in a natural fashion. 
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5. Partial Enumeration Techniques 


A fourth approach, partial enumeration, is basically a 
branch and exclude method with various rules envoked for the 
purpose of exploring only certain branches of the tree. 

A method for partial enumeration by Balas [1] is pre- 
sented for the case where x5, (j=1,....n) equals 0 or l. The 


problem to be solved should be formulated 


n 
(12) Maximize yp = nr © + bp 
n 
Subject to y, = b, + P 245% 2 
j=1 
fiat .««sm andy x..~ 6lor 4, jel... 


rn (2) 7 alt c. must be non-positive. If this is not 
the case, 7“ may be replaced by (tax) for any Cs > 0. Also, 
some b; must be negative or the problem has the trivial solu- 
tion with all a = 0. 

There are 2” different possible solutions. The algor- 
ithm seeks to find an optimal feasible solution or knowledge 
that none exists without having to evaluate each of the 2F 
possible solutions. The algorithm is in the form of a tree 
search. A path along the tree of solutions is traced until 
either a new feasible solution is obtained or a node is 
reached which yields information that all solutions in which 
that particular node is included may be ruled out of consid- 
eration. The process then backtracks to the unique node 
that immediately precedes the one ruled out and departs that 
node on a different path unless none are left and it becomes 


necessary to backtrack further. When the process is pushed 
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back to the starting node and information is obtained that 


no other branches of the tree need be explored, the algorithm 
terminates. 

Define So to be the set of variables presently set equal 
to zero and Sy as the set of variables presently assigned a 
value of zero or one. 

Record the value of Yo for the current best known solu- 
tion. Call this value Yop° Record the current values of 
Yor Yyreser¥m 8S Your Yigre** Ying and the maximum possible 
values of YyrYore++0¥y_ as Yim'Yam'* °°? Yim obtained by chang- 


ing the variables in S, so that 


0 


+) max(0,a; 5) {i=1,.). Fm) 
3 


Yic 

and j is the set {j: x. « S,}. 
3 7 © 

Initially Yop may be set equal to -® and the current 


subproblem has all variables in S The general nature of 


0° 
the algorithm is: 
1. Consider a subproblem. If You & Vob abandon the 
subproblem. Otherwise if ally, 2 0 for 


(i=l,...,m) a new best feasible solution is 





found. Abandon the subproblem since all oa < 0 
and it is unprofitable to assign any variable in 
Sy a non-zero value. 
2. Otherwise if of < Yop ~ Yoo for any j, put x5 
in Sy and assign it a value of zero. Revise the 
values of Fenn” If and revised Vain < 0, abandon 


the current subproblem because it cannot have a 


feasible solution. 
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lt Ys te ais 


an assigned value of zero and revise the Yam' 


< 0 for some i, put x5 in Sy with 


This should be repeated for each You since a 

variable was last assigned to S,; or until some 

vy .* 0. 

If Yin ~ 7 < 0 for some i, put x, in Si with 

an assigned value of one. Revise all Se and 

Yim’ 

T= no x5 is assigned a value of one in step 4, 

a branch must be made. A variable in Sp is 

assigned to Sy with a value of one and at the 

same time a new subproblem is set up that is the 

same as the current one except that the variable 

is assigned a value of zero. The choice of 

variable is made by taking that variable that 

when set equal to one increases at least one 

negative Vie and makes the greatest decrease in 
m 

the sum re max (0,-y;.). If two or more var- 
i=l 

iables are tie, the one with the largest o is 


used. 


An algorithm by Glover [10] which in its simplest form 


is similar to the "All Integer Method" of Gomory, but rep- 
resents a weakening of the constraints of this algorithm 

was also a proposal for sharpening the tests of the algor- 
ithm of Balas [1] and hence reducing the size of the solu- 


tion tree. 
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Geoffrion [8] outlined a version of the algorithm by 


Balas [1] which lends itself to computer implementation. 

Balas' [2] filter method is an accelerated version of 
his earlier “additive algorithm". In the filter method a 
two phase approach is used where in phase I an auxiliary 
problem is constructed that, in phase II, is used to 
"filter" the solutions to which the tests of the additive 
algorithm are to be applied. 

Clevercenumerative schemes are in certain situations 
the best methods of solution. An algorithm for the computa- 
tion of knapsack functions by Greenberg [18] falls in this 


category where the problem is 


x3 n 
(13) Maximize } c.x, < 
n 
Subject to ) a,x, = L 


x, > 0, and x, integer, 


where each c, is a positive number, each a. is a positive 
integer, and L is a positive integer. In the usual knaps 
sack problem the constraint in (13) is an inequality con- 
straint. It can be assumed in this formulation that slack 
variables have been added to convert the inequality to 
equality. 

The one-dimensional knapsack function is defined from 
(13) as: 


n 
14) F(x) = ted 
oe i Ae sie i eh a 7 


ar integer } : 
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If F(x) can be found for all values of x and in turn 


the *, found that produces the solutions, then (13) is 
solved when F(L) is found. 


The knapsack function can be written as 


(15) F(x) = max [c. + F(x-a.) ] 
jiag < = J 
J] -~ 
with initial condition F(0) = 0, for values of x that are 
feasible. 


One immediate solution to (15) can be found by find- 
ing a, = min ays for all j. This produces F(a,) = c.. 
Then replace x by x - a, in (15) and obtain 

(16) F(x-a_) = max [c. + F(x-a_-a.)] , 

3 Jia, + as < J =e 
r j- 

which can then be substituted for the F(x-a,) term on the 
right side of (15). Another immediate solution can then be 
produced. Continue in this manner until F(L) is found or 
until all values of F(x) that are desired are found. Keep- 
ing track of which j produces the solution will enable us 


to determine the optimal xy at the end. Only distinct 


and Gs. > ¢ 


values of a, are considered. If a. = ay aie 


j # k, then take x, = 0. 


The procedure may be summarized in the following four 


steps: 
De List the values of the problem as follows: 
E 2 3 Price n 
Cc) Co Cy #63 ch 
ay as a3 4 an 
x. = 0 
B; 


a5 





ae Given the list find an 7 min a.j/for columns in all 


as > m 
sections. If a, = L go to 4. Otherwise set m = a, 
and go to 3. 
2, Add a new section of columns to the list, if possible, 
as follows: 

Calculate ay = a. + ay and o....= Cy + Cy For se =) 1, 

---,;n. Add a column headed by t/jif: 

(a) ay eS Li. 

(b) ay is not on the list. 

(c) ay is on the list and has a corresponding 
c. value that is smaller than Ch. 

(d) Underneath the section added write the x4 
values from the section where m = a, was 
found. Increase Xx, by one for the new 
section. Sections after the first may be 
deleted after they are no longer needed. 

Go to 2. 
4. The problem is solved with solution Cy. The values 


of the variables are found below the section where 
a, = L appears, increase x, by one. 

This completes the algorithm. This algorithm has the 
computational advantage of being a single pass algorithm and 
does not require backtracking. 

To illustrate this method the following problem is con- 
sidered: 

Max 2X, + ao. + 5X3 
when 2x) + 3X5 + 4x3 = 6. 
x, 2 0, X, > 0, x3 2 0, all integer. 
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1. We list the values of the problem as 


1 2 3 
: 10 
2 a 3 5 
i 2 3 4 
x. = 0 
A; 
Set m= 0. Go to 2. 
2. Given the above list we find a. = min a, = 2. Set 


m = 2 and go to 3. 
3. Write the new section as 


2 3 


16 

“= 7 
5 6 
x) =p Ike 


4. We obtain min a, = 3 in 1. No new section is 
added. 

5. We obtain min a. = 4in1. No new section is 
added. 

6. The solution is now evident in 3, where as = 6. 


We thus have F(6) = 7, x) = if, X3 = l as optimal. 
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6. Dynamic Programming Methods 


The solution: of a linear program is generally easier 
than that of an integer program. Given a linear program to 
be solved in integers, it is tempting to solve the linear 
program and then, by some process, "round" the noninteger 
valued variables into an optimal integer solution. Partic- 
ularly appealing results of Gomory [13] have led to a 
dynamic programming process for rounding a linear program- 
ming solution into an optimal integer solution. 

Two such approaches will be presented in this section; 
one for the knapsack Peciileh and the other, a continuation 
of the same method, for the solution to a more general 
problem. 

The first algorithm by Greenberg [16] is one for 
solving co 

(17) Minimize CX 

Subject to AX = B 

x, > 0 and integer (j=l,...,n), 
where X = a C is an n-vector, B 
is an m-vector, and A is an mxn matrix. It 
is assumed the elements of C, B, and A are 


integers. 





The linear programming solution to (17) transforms 


(17) to 
(18) Minimize d+ )_ c.x. 
jeG ay 
Subject to X, + )_ a,x, = ap 
jeG 
= > 0 and integer (j=1,...,n), 
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where X, = {x, |ieG}, “2 0, G is the set of indices of the 


G 


basic variables and G is the set of indices of the non-basic 


variables. The vectors a (j=0 and jeG) are column vectors. 


The components of Gy are non-negative. Ifa, is all integer 


0 


then x, = O €icGi. = is an optimal integer solution. 


ec 
If any of the Gy are fractional then (18) may be reduced to 


an equivalent knapsack problem 


(19) Mimimize, |] o.x. 
jeG 5 es) 


Subject to )}  a.x. = b(mod D) 
jeG 


%, > 0 and integer, 
where the constraint in (19) is a congruence and D is the 
determinant of the coefficients of the Xi (ieG) from (17) 
or a reduced value. It is assumed that Cy, a, and b are 
integers. The c, in (19) are the c, in (18) multiplied by 
D. The congruence in (19) is developed by finding the 
equation in (18), including the objective function, that 
has any constant, written in fractional form, having the 
property that its numerator and denominator are relatively 
prime. In this case the denominator is D. Gomory [14] 
shows that if we find a constant with this property then 
the congruence taken from the equation where the constant 
appears generates the congruences developed from the other 
equations. The cutting plane developed from the congruence 
represents the best cutting plane since any integer solution 
to the congruence produces integer solutions for the x; 


(ieG) in (18). 
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Although it may appear that the search for a constant 


with the property that numerator and denominator are rel- 
atively prime is a tedious one, there is a simple and rapid - 
way to find the equation containing the constant. The re- 
vised simplex method is used to obtain the linear program- 
ming solution to (17). Therefore the inverse matrix is 
available to develop the constants in (18). In solving (17) 
the value of D is carried along as the product of the pivot 
elements. The desired equation is found by finding the 
greatest common divisor of the non-zero. numerators of each 
of the rows of the inverse matrix. The procedure is stopped 
when the greatest common divisor is unity. If none of the 
rows produce a greatest common divisor of unity, the row 
with the minimum greatest common divisor is selected. The 
greatest common divisor of the greatest common divisors of 4 
each row also divide D thereby producing a smaller value of 
D by dividing. An enlarged inverse matrix is also used in 
considering the objective function. The procedure in [5] 
is used to find the greatest common divisor of the elements 
of each row of the inverse matrix. 

Before the above procedure, the Euclidean algorithm 
is used to examine the a7 and d. When a fractional constant 


having unity as the greatest common divisor of the numerator 





and denominator is found, the procedure stops. If the re- 
quired row is not found then the inverse matrix is used as 


described above. 
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A problem which is given in [3], to illustrate Gomory's 


algorithm, is solved below by the method just described. 


(20) min + 4x. + 5x 


Z 2 

; subject to 3x4 + Xo - X3 = 2 

x1 + 4x, - X, = 5 

3X4 + 2X5 ~ X= 7 
Xs > 0 and integer. 

The continuous solution gives us 
: - $22 7 a3 
(21) min + = + To*4 + To*s 

2 4 _ te 
* * ote" 4 WO" 5.” IT 
3 i » 
%2— Sard lee 7 Fe 
3 = 42 
~ 2 


dal 
oy? es = TeX 
where D 


Considering d = i, a) = (re. = i), we see that none 


have numerator and denominator relatively prime. The in- 


verse matrix is 





te wz? 
ot FO 
1 Fo 
. hr DT? 


| where the bottom row produces the coefficients in the ob- 
: jective function. In the first row we consider the great- 
est common divisor of (-2,4) which is 2. The first row 


produces the first constraint equation in (21). In the 
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second row we consider the greatest common divisor of (3,-1) 


which is unity. Thus the required congruence may be obtain- 

ed from the second constraint.in (21). Similarly, the re- 
quired congruence may be obtained from the third constraint 

and the objective function. Using the second constraint 

we obtain the congruence 


7x, + *. = 8 (mod 10) . 


4 a 
The equivalent knapsack problem becomes 
minimize 7X4 + lix, 
when 7X4 + X, = 8 (mod 10) 
Xqr Xe > 0 and integer. 
In general, once the required equation in (18) is found, 
e.g., 


x“ = ie 05 5%, = 455 for a single ieG 


(or for the objective function) the congruence is found as 
in Gomory [13] as 

Apex. 2 oy, | Ged. 1) 

fecip ss! 2 i0 


where rr is the fractional part of i4° Multiplying 
through by D, we obtain 


.. aX, = b (mod D) 


where a, = 54D, b = As QD : 


We are now interested in a solution to the equivalent 
knapsack problem which is in the form of (19). We can 
assume that no value of a5 appears more than once (if not, 


we can select the one with smallest c, value). Writing 


42 





equivalent knapsack problem is 


Minimize 7X4 + lix 


5 
Subject to 7x, + Xe = 8 (mod 10) 


4A 


Xqr Xe 2 0 and integer, 


we list 
4 5 
7 iy 
7 1 : 


Thus 7 = min .. F(7) = 7, I1(7) = 4. The list becomes 


(Marking the first column) 


a 5 4 be 
7 11 14 18 
% it 4 8 


Thus F(1l) = 11, I(1) = 5. The list becomes 


4 = 4 5 5 
7 11 14 18 22 
7 z 4 8 2 
* * 

F(4) = 14, 1(4) = 4. The list becomes 
4 5 4 5 5 
i) a 18 22 25 
7 at 8 2 5 
k * 

F(8) = 18, I1(8) = 4. We stop. 

Backtracking I1(8) = 4, X4 = iL 

BO =e, x5 = 1, end. 


The solution is F(8) = 18, X4 = alae Xo = Ls 
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Approximately 25 problems have been tried using this 


method [16] where there was a maximum of 2000 variables and 
150 equations. The method was used to solve integer pro- 
grams arising as covering problems. Usually the method 
produces an immediate integer solution. If the knapsack 
solution does not produce feasible (positive) integers to 
the problem, success has always been obtained by adding a 
Single cut. 

The above algorithm has been extended by Greenberg [17] 
for integer solutions to bounded variable linear programs. 
As previously, the continuous linear programming solution 
is first found. If the continuous solution is fractional 
then a linear congruence is added as a constraint. The 
problem is then put into a dynamic programming format and 
the optimal integer solution found. 

The algorithm presented is for solving 

(25) Minimize CX 

Subject to AX = B 
0O<x, <b 


7 
iy J 
), C is an n-vector, B is an m-vector, 


%, integer, j=1,...,n, 
where X = (Xy 7-6 Xk, 
A is an mxn matrix and the bs are integers. It is assumed 
the elements of C, B, and A are integers. In this formula- 
tion the win may be infinite. This algorithm also includes 
the case where the . are restricted to be either zero or 


one. 


A bounded variable linear programming technique is : 





used to obtain the linear programming solution to (25). 


This transforms (25) to 
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(26) Minimize d+ J) c.x 


ee 
Xo + J Os%. = Oo, 
je 
@ < x4 < Doe =! integer, j=l,««ee NT, 
where the vector Xo = {x, icG}, G is the set of indices of 


the basic variables, and G is the set of indices of the non- 
basic variables. Further, some of the non-basic variables 
may be at their upper bounds in the continuous solution of 
(25). For those variables their corresponding Cy values 

are non-positive. Also, Cy > 0 for non-basic variables that 
are at the zero value. For ease of computation, we make 

the transformation x4 = be - x. for those non-basic var- 
iables at their upper bound. Thus we may assume a form 

like (26) with all &, > 0 and all non-basic variables at 
zero values. The vectors i ae and jeG) are column vec- 


tors. The components of a, are non-negative. If ao is all 


0 
integer then x, = e Geer, Xq = Gq is an optimal solution 
(if any of the 5 jeG are really the x, under the trans- 
formation, then #5 = Ras If any of the Gp are fractional, 


problem (26) is converted to the problem: 


(27) Minimize y "alx 


py I 
when hg 5X5 SO 

ide a,x; = b (mod D) 

0< x; < by. x, integer, jeG. 
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The inequality constraints in (27) are obtained from (26) 


by dropping the x,, icG. D ia the detdrminant of the co- 
efficients of the x,, ieG from -(25). The value of D may 
be found as the product of the pivot elements during the 
simplex procedure for obtaining the continuous solution of 2 
(25). The linear congruence in (27) is a single congruence 
where the a, and b are integers. The congruence results 
from the requirement that all Kis ieG, be integers. 

After finding the congruence in (27) a dynamic program- 


ming formulation of (27) is developed. Writing 
F(x,a,8) = mia a °5%4! 2s aj%4 SO) 
42g as%y * x (mod D), 0 < eX, Cm: 


the dynamic programming recursion 


(28) F(x,a,8) = min (oj+F(x-a, aa, )B~e,)) ; 
4eG 


F(0,a,8) # 0 fora > 0, 8 > O, 
is obtained. The x argument of F is taken modulo D. The 
vector e, is composed of a unit element with the other el- 
ements zero. The unit element corresponds to the unit co=- 
efficient of x, in %, Ss bye It is assumed that only fea- 
sible values of x, a, and & are used in (28). 
One immediate solution to (28) can be obtained by 
» Then 


5 
replace x by x = &., a by a - a., and @ by 6 - e, in (28) -_ 


finding co. = min Cy. This produces F(a, 10./@,) =a 


and substitute the result for the (xa ,d-0,.,8-e,) term on 
the right side of (28), then another immediate solution can 
be produced. Continue this way until F(b,a,8) is found 
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where 0 < Ay = o < Be and 8 < ba where the vector 


ba = {b, | ieG} and the vector be = ib, |ieG}. This entire 


procedure is contained in the following algorithm: 


1. Suppose the indices in G are (1,2,...,m), list 


the values of the problem as 








A: 2 3 ae m 

Cy Cy C3 : Cn 

ay ay a3 aad an 

' = 0 
ms 
Go to..2. 
2. Given the list, find Cc. = min cy for all unmarked 

columns in all sections. If a, = b and 
O< Ap - a. S$ Be go to 4. Otherwise mark the 


column and go to 3. 
3. Add a new section of columns to the list, if pos- 
sible, as follows: 


(a) calculate cs =o. + Cy, a ad Oss 


a4 Fata, (mod D) for all values of jeG 
(i.e., values j, Cyr Os, a, are taken from 
the list in step 1.) where xy <b. for 
j # xr and where x, + l< b. for j = r for 
the section containing the newly marked 
column. 

(b) add the column headed by j in the new section 


with values c!, a' and ai. 
7° 5 
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(c) Underneath the section added write ihieox,, 
values from the section containing the newly 
marked column. Increase x, by one for the 
section. When columns in. new sections become 
marked they may be deleted after the calcula- 
tions are made and the new section is added 
to the list. A new column may already be on 
the list. It need not be added if the x, 
values in corresponding sections would co- 
incide (after increasing the x, values by one 
for the j heading values of the two columns). 
Go to 2. 

4. The integer problem is solved with objective func- 
tion value d + Ch. The values of the basic var- 
iables in (26) are Xq = % - aL. The values of 
the non-basic variables are found below the section 
where a. = b appears; increase x, by one. 

This completes the algorithm. The algorithm may be 
simplified by calculating as only when as = b by using the 
proper x5 values and the Os from step 1. An integer solu- 
tion is sure to be found because all integer solutions to 
the congruence in (27) are systematically produced in order 


of increasing objective function value. 
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To illustrate this procedure we use the problem given 


in [2] as 


Minimize 5X1 + 7X5 
when x, 7 3X5 
~2x) = 6x5 

- 2, 


@ <se2 < Ly 
— o> 


+ 10x, + 3X4 + Xs 

+ 5X3 + X47 4x, Je 
- 3x. - 2X4 + 2X5 > 2G 
+ 2X3 - X47 X52 1 


integer, j=l, « i «.r. 


We introduce surplus variables Xe > 0, x5 > 0, and X_ 2 0 


(i.e., with ©» as upper bounds) and find the continuous 


solution and equivalent problem: 


(29) Minimize 


42 24 137 

9*5 ay Mg hg 

13 7s 

“ee ig Fe ome LL Sa 

4 1 > 

O*5 Toe * ee Seas 
2 i ae! 

9*5 gy T ae = SF 


_ 93 156 
CT eae 5%] + 7% + 
when 
7 28 
- 9*1 - “9x4 + 
- + X, - Be - 
ry 3 o*4 
7 
ale? tite ia aed 
O< x5 <1, x, integer, j=l,...,5 
Ges X57 j=6, 7, 8. 


We have D = 9. The second equation produces the congruence 


7x, + X 


i 4 5 


+ 5x. + 8x 


7 


+ 3x 


which is added as a constraint. 


where applicable, we list 


51 


8 


= 6 (mod 9) 


Multiplying through by 9 





x, = 0 


For convenience we include at the left of the list the 
objective function value, the right hand sides (multiplied 
by 9) for the equalities in (29), and the right hand side 


for the congruence. We have 24 = min Cy, 1.@., oO. = 24, 
with fF = 7, We add the section 
(31) i ae? Bh og 8 > 
117 180 66 48 w61 . 
“6 =-27 14 2 =2 
=3 =9 =5 =2 =7 
=6 “9 -1 <4 l 
‘ss: 6 4 7 a 
%, = 1 


We mark the 7 column in (30). We have min ey = 42 from < 
(30); we add the sectien 
(32) au 4 8 


135 198 178 

6 =15 10 

=6 =12 =10 

=3 =6 4 

3 6 8 
a 











We need not add a column headed by 7 in (32) because it 


would duplicate the 5 column in (31) 


i column would require X5 = 


5 column in (32) since X-. 


1 and Xo 


would be 


in (31). We add the section 


(32). We mark the 5 column in (30). 


The solution is now apparent 


(33) 1 a 5 7 
141 204 90 72 
-5 -26 15 3 
-4 -10 -6 -3 
| 5 kth om weg 
5 g 3 6 
. x. = 2 
We mark the 7 column in (31). We 
- (31). We add the section 
(34) 1 4 8 
L529 222 203 
-7 -14 ra 
-7 -13 -11 
-5 -8 2 
2 B: "i 
x, = ds Xp 
We mark the 5 column in (31). 
in the 7 column in (33). 
x7 = Sp Xe = (3-3)/9 = 0, X3 


(the use of either 


= 1). We do not adda 


at its upper bound in 


185 


have min Cy 


= (6+3)/9 = 1, x 


the value of the objective function is 9 + 72/9 
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We have min Cy = 


66 from 


We have the optimal solution 
= (3+6)/9 


= 17. 
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7. Summary 

Since 1954, the field of integer programming has made 
rapid progress. Many new approaches have been tried on 
various type problems with varying amounts of success. The 
developments’ in computers have enabled many problems to be 
solved today that fifteen years ago could not be handled, 


Many computer codes have been developed around the algor- 


ithms presented here. Information on computational expe- 


rience with these codes is scarce and publications in this 





area are lacking. The little information that is available 
indicates there is much to be tried and certainly room for 
clever imaginative schemes for solving this type of prob- 
lem. Possibly the best approach or method for solution 
will be a scheme employing all of the categories described 


in this thesis. 
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